afraid to say

phrase

variants or sorry to say or regret to say

—used as a way of expressing one's disappointment, regret, or sorrow

Most of us worked very hard, but she, I'm afraid to say, did no work at all.